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Abstract 

We examine problem of existence of stationary random fields with lin- 
ear regressions and quadratic conditional variances, introduced by Bryc 
Distributions of the fields are identified and almost complete descrip- 
tion of the possible sets of parameters defining the first two conditional 
. moments is given. This note almost solves Bryc's problem concerning 

^ ' fields undetermined by moments - the only remaining set of parameters 

^ for which the existence of Bryc's fields is unclear has Lebesgue measure 

On ' zero. 

(N 

. 

. 1 Introduction 

, This note deals vifitli square integrable random sequences X ~ (Xfe)^^^ with the 

' first two conditional moments given for all A; G Z by 

E{Xk\--.,Xk-2,Xk-i,Xk+i,Xk+2, ■■■) — L{Xk-i,Xk+i) , (1) 
'E Xk-2, Xk-i, Xk+i, Xk+2, ■■■) ~ Q [Xk-i, Xk^i) , (2) 



where L is a symmetric linear polynomial and Q is a symmetric quadratic 
■ polynomial. Such processes have been considered by Bryc |2], who, among 

other things, identified one-dimensional distributions of X for a special class of 
quadratic functions Q. In ,3, Markov chains with the same conditional structure 
has been investigated. In [H] a thorough analysis of the condition defining first 
conditional moments in Bryc's paper j2| has been carried, which has made it 
possible to omit some of the assumptions from |2| and simplify the proof of the 
result contained therein. 

The aim of this paper is to analyze random sequences satisfying (^) and l(2Jl 
without any restrictions on the parameters defining polynomials L and Q; the 
main result is Theorem ^ in which description of almost all possible combi- 
nations of the parameters is given and the distributions of the sequences are 
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identified. One of the conclusions of this analysis is partial negative answer to a 
question posed by Bryc in whether there exist processes satisfying |^ and 
1(21, whose one-dimensional distributions are not identified by moments. The 
answer is based on some calculations involving Al-Salam-Chihara polynomials, 
as it was shown in 15. In addition, we reduce a number of assumptions from 



The paper is organized as follows. Subsection II . II lists the assumptions used 
throughout the paper. Section |21 contains the statements of the main results 
(their proofs are presented in section 0)) and some remarks. The next section 
contains auxiliary results and their proofs. 

1.1 Assumptions and notation 

We will follow Bryc in using the term random field for X, for additional com- 
ments see in]- 

Let X = be a square integrable random field indexed by the integers, 

with non-degenerate covariance matrices and constant first two moments, that 
is EXk = EXo, = EXq V/j e Z. After Bryc 0, we assume that conditional 
structure of X is given by and (O with 



a, b, A, B,C,D M. Non-singularity of covariance matrices implies that all ran- 
dom variables Xk are non-degenerate and there is no loss of generality in as- 
suming that MXk = and EX^ = 1 for all fc e Z, which implies 6 = 0. 

It has been shown in ^ that Q implies L2-stationarity of X. Since the 
case p :— corr {Xq, Xi) = contains sequences of independent random variables 
(which satisfy iQJ and lO but can have arbitrary distributions), we shall ex- 
clude it from the considerations. Observe that non-singularity of the covariance 
matrices implies \p\ < 1. By Theorem 3.1 from (see also Theorems 1 and 2 
in [HI), COTT (Xo, Xk) = p''"' and one-sided regressions are linear 



Multiplying Q by Xk-i and taking the expected value, we see that a = 



Let us define (t— algebras J^<m := f (-''^fe : k < m) , T>rn '■— c (-''^fe : k > m) , 
T^ra '■= f {,Xk ■ k ^ to) . Throughout this paper suppX stands for support of a 
random variable X, denotes cardinality of a set A, Ia is its characteristic 
function, and Sp is the Dirac measure concentrated on p e M. 

2 Main results and an open problem 

In 12 it was assumed D — and 



L {x, y) = a{x + y) +b, 

Q {x, y) = A (x^ -I- y^) + Bxy + D{x + y) + C, 



E(Xfe|...,X_i,Xo) =/Xo. 



(3) 




(4) 
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The following Theorem describes all valid combinations of parameters from 
^ (note that taking the expected value of jSJ one gets that C = 1 — 2 A — Bp^) 
and identifies the distributions of relevant fields. 

Theorem 1 There do not exist standardized random fields X = [Xkjkez with 
non- singular covariance matrices, satisfying 0) and 0) and p ^ 0, unless D = 
and either B — or ^ holds with B £ Bi U B2 U B3, where 



Furthermore, ifD = B = OorD^O and ^ holds with B £ B2 then the 
relevant fields exist and have the following distributions: 

1. If B ~ and A ^ 1/2 then X^. = ^k+i /"'^ '^^^ */ additionally there 
exists fcg G Z such that Pr(XfeQ = 0) = then = RY^, R and are 
independent, i? > 0, Ei?^ = 1 and all random variables Y^ are symmetric 
with values ±1; 

2. If B = and A^ 1/2 then all random variables Xk are symmetric with 
values ±1; 

3. If ^ holds then for all B e (o,2p^ / {l + p^)^^ all one- dimensional distri- 
butions of X are equal to a uniquely determined symmetric and absolutely 
continuous distribution ( depending on B) supported on a finite interval; 

4. If holds and B = 2p^/ (l + p^f then Xk - Af (0, 1) for all keZ. 

Theorem 2 // ^ holds with D = and B Bi then there do not exist the 
relevant random fields X satisfying jillj)] with p ^ and such that sequence 
{X'^)k is uniformly integrable and Pr(Xfe_i = 0) < 1. 

Open Problem 1 Do there exist random fields X satisfying 1) ilijj] with p ^ 0, 
D — 0, and such that ^ holds with B Cz B3? 

Theorem O strengthens Theorem 2.3 from 3 by stating that X is always a 
Markov chain and relaxing assumptions for the uniquely determined case. 

Theorem 3 // X zs a standardized random field with non-singular covariance 
matrices, satisfying 0J) and P 7^ 0, and such that D ~ B = or D = Q and 
^ holds with B £ B2, then X zs a stationary Markov chain. X has uniquely 
determined finite- dimensional distributions unless B = D = and A = 1/2. 

Clearly, ii A = 1/2, B = D = then distributions of X can be arbitrary 
(but symmetric). Observe that in this case condition (j^J is trivial. 



3 



2.1 Remarks 

1. Unlike Bryc [2], we do not assume L2-stationarity of X (which is proved in 

nor do we assume equality of its one-dimensional distributions (it is 
stated in Theorem^. However, to give a simple and uniform description 
of the considered random fields, we shall apply some results of Bryc from 
[2] • One can easily verify that the results from ^ , used in sections |31 and 
01 do only use assumptions listed in subsection ll.il fin particular, they do 
not rely on the equality of one-dimensional distributions of X) . 

2. We do not use assumption (6) from |2]. The only restriction on the cor- 
relation coefficients (apart from those stemming from non-singularity of 
covariance matrices - see [S], Remark 2) will be requirement that p ^ 0. 

3. Bryc [2] assumed D = and ^ and introduced new parameters 



Using some facts concerning g-Hcrmitc polynomials he proved (under ad- 
ditional assumption of equality of one-dimensional distributions, see [2j, 
Theorem 3.2) implications (3) and (4) of the above Theorem and the fact 
that then there do not exist X with R < (equivalently B < 0). (If 
R = B = then Bryc showed that one-dimensional distributions are 
symmetric with values ±1, what can be deduced from Theorem ^ since 
then implies A = + ^ 1/2.) Bryc also raised a question 

(Concluding remarks, 4) whether there exist stationary processes which 
satisfy conditions Q, HI, Q and D = 0, corresponding to i? > 2 (equiv- 
alently B > 2p'^ / (l + p^) ). As Theorem n] shows, the answer is almost 
negative. More precisely there exists a discrete set of possible values of B 
all contained in the interval (2/3^/ (l -I- p^) , 1] for which one-dimensional 
distributions of X have all moments but are not determined by moments 
and all conditional distributions Xj\Xk, j ^ k are discrete. 

4. The densities from implication (3) in Theorem ^ have explicit product 
representation - see 0, Concluding remarks 3. 

5. Observe that the case considered in Theorem |21 leads to undefined value 
of q (see (O). Therefore it has to be examined separately. In this case 
(unlike in cases in which g as a function of B is determined), we cannot 
apply Corrolary 5.1 from ^ and deduce existence of higher moments of X. 
If we knew that all moments exist, then of course wc could have dropped 
the uniform integrability assumption. 

3 Auxiliary results 

Proposition 4 Let A ^ 1/ {l + p^) . If # supp Xk = 2 for all k then D = B ^ 
and Xk ((5-i + Si) /2, or gj) holds and D = 0. 




(5) 
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Proof. From the proof of Lemma 5.2, |2] (note that there is a minor misprint 
in [2] in the formula for E (X^|Xo), repeated in the proof of Proposition 3.1) it 
follows that 

E {Xl+AT<k) - a,Xl + P^Xk + 71, (6) 
E (^2^2 \T<k) - a2Xl + P2Xk+ 72 (7) 



with 



A{l-p^)+Bp' (1 + {A + Bp') p2 



l-A(l + p2) ' - l-A(l + p2) 



l-^(l+p2)'^^ l-A(l+p2)' 



C C(l+p 



,2^ 



71 = -; tt;— — ^,72 = 



l-A(l+p2)'- l-A(l+p2) 

Observe that E (X2_^2l-^<fc) = E [E (X2^2l-^<fe+i) l-^<fc] , therefore for all A: £ Z 

a2Xl + P2Xk + 72 = ajXl + XkPi (ai + p) + 71 ("i + 1) • (8) 
First assume that 

= a2 

Pi{ai+p)^(32 . (9) 
71 (ai + 1) = 72 

This after some easy algebra gives 

D {C-{l~p) p[l-A{l + p')]} =0, (10) 



C 



A[p' + 1,]+B-1 



= 0. (11) 



If C= then Z? = by (O and A = (1 - Bp') /2. From ® , E {X^^^ \T<k) = 
Xl. Consequently, by symmetry, E {Xl\T>k+i) = ^^+1, hence E (X^_^^|X^) = 
Xl and E (X2|X2^ J = Xl^^. By a result of Doob (see 0, page 314) Xl = 
Xl^i, so (since #suppXfe = 2) ^2 = 1 and Xk ~ (^_i+^i)/2 for all fc. 
From — p') = 0, so i? = by the assumptions on covariance 

matrices and A = 1/2. 

If C 7^ then I^J implies Q and takes the form 



Dil-p){l + p') (^^-a)=0, 



hence D = 0. 

Now assume that does not hold. Then the values of Xk have to be the 
roots of (|H1), so all Xk have to be equidistributed. Observe that EX| = for all 
fc e Z. Indeed, applying twice one gets 



E{Xk-iXkXk+i) =E[Xk-iXkE{Xk+i\T<k)] = pE {Xk-iXl) 



= pE [E {Xk-i\T>k) Xl] = p'EX^ 
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and on the other hand, by using ^ and 



E {Xk-iXkXk+i) = E [Xk-iE (Xfcl J-^fe) Xk+i] = (EX^i + EXl^,) . 

1 + 

Thus Xk ^ (S-i+Si) /2 and from @ 

B {Xk-iXk+i -p')+D {Xk-i + Xk+i) = 0. (12) 

Define Fi := {Xk-i — —Xk+i} , F2 := {Xk-i = -'^fe+i} • By the assumptions on 
covariance matrices Pr (Fi) ^ 1 and Pr (F2) ^ 1. Applying (|12|l to a; £ Fi and 
a; e F2, we get i? = and D = {]. Note that reduces to a trivial identity. □ 

Proposition 5 Let A 7^ 1/ (l + p^) . If there exists ko £ Z such that supp X kg > 
2 i/icK ezi/ier A=l/2,i3 = C = L' = and = X^^^ for all k, or Q holds 
and D = ^ C. If, additionally, there exists ki G Z such that Pr(Xfcj^ = 0) = 
then in the first case we have X^ = RY^, where -R > 0, {^-1 + ^1) /2 for 

all k and R and Yfe are independent. 

Proof. We keep the notation from the proof of Proposition^! If there exists 
fco G Z such that #suppXfe(, > 2 then must be satisfied, so H1Q(I and Hll|l 
hold. 

If C= then Xl = Xl^^ for all /c G Z as in the proof of Proposition^ By 

Xk-i[{2A^\)Xk-i+BXk+i]=Q. (13) 

Observe that {Xu-i = 0} = {Xu+i = 0} , so if A 7^ 1/2 (hence B ^ 0) then 
Xk+i = Xk-i (1 — 2A) / B, which contradicts the non-singularity of the co- 
variance matrices. Note that \i A ~ 1/2 then (0) is automatically fulfilled. 
Since X"^ — X'^^^ —: R^, where R > 0, then, under the assumption of lack 
of atom at 0, Xk = RYk, where suppFfe = {-1,1}- By E{Xk\Xk-i) = 
REiYk\Xk-i) = pRYk-i,soE{Yk\Xk-i) ^ pYk-iandEiYk\R) = pE{Yk-i\R) . 
Analogously, E (Yk-i\Xk) = pYfe and E (Yfc^i |i?) = pE (Yfe |i?) , therefore E (Yfc-i = 
EiYk\R) = 0. Hence E(Yfc) = and Pr (Ffc = 1\R) = Pr (Yfe = = 1/2. 

Thus Yfe and R are independent and Yfe ~ {6-1 + 61) /2. 

If C 7^ then Hll|l implies and Z) = as in the proof of Proposition 0] 

□ 

The following Lemma will be used in the proof of Theorem |21 

Lemma 6 Suppose that ^ holds with D — and B £ Bi. IfQn '■— c {^<k-i, J'>k+n) 
then for all n — 1,2, ... and fc e Z 

E(A^,|C/„j - ;^_^2n+2^fe-l+i_p2n+2^fc+n+ ^n+l _ ^2n-h2) ^k-lXk+n- 

(14) 

Proof. The proof is by induction on n. ()14|l for n = 1 is (jSJ. 
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Assume that the assertion holds for some n > 1 . Then 

E (Xfe2|g„+i) = E [E {Xl\T^k) ISn+i] = 

= AXl_^ + AE (Xfc\i|g„+i) + BXk-i¥. {Xk+i\gn+i) ■ 

By the induction assumption 

E = E [E {Xl+^\a {T<k,T>k+n+i)) IGn+i] = 

1 — p^" 1 ^ 

= 1^ _^2«+2^ {XllGn+l) + ^ _^2«+2^fc+n+l + 

This, formulae 



pU+l _ p-n-1 P — - 



^2 1 



; {Xk+l\Qn+l) = ^„+2 _ ^-2-«^fe-l + p«+2 _p-2-n^'=+'H 



(see inj, formula (3.4) in the proof of Theorem 2) and an easy observation that 
1 - A (1 - / (1 _ p2n+2j _^ Q j^ii nen, completes the proof. □ 

4 Proofs of main results 

Proof of Theorem ^ A starting point of our considerations is Lemma 5.2, 
formula (16), 0: 

E (Xfe%i \T<k) [1-^(1 + p')] - Xl [A (1 - p') + Bp"] + XkD (1 + + C 

(15) 

(in fact, the above formula in |5] is given for fc = only but from its proof it is 
evident that H15|l is true for all A: G Z). 

If A = 1/ (l + p^) then ifT^ is a quadratic equation and if ^ (l - p^) +_Bp^ ^ 
0, equivalently B ^ i^p^ ~ ^) I [P^ {P^ + ^)] ' ^^'^ solutions, therefore all 

Xk must have the same two point distribution. Repeating the reasoning from 
the proof of PropositionQl we see that EA"j|! — for all fc, so Xk ^ {S-i + Si) /2 
and B = D = 0. 

If A = 1/ (1 + p2) andS = (p2 - 1) / [p2 (p2 + 1)] thenC = l-2yl-Bp2 = 
and I? = by (|15|l . This case is analyzed in Theorem |21 

Now assume ^ ^ 1/ (l + p^) . By Propositions21and|5l it suffices to examine 
the case when (0} and D — hold. (This is the combination of parameters 
assumed by Bryc in 0.) In this case, E \Xkf < oo for allp > 1 by Corollary 
5.1. By the proof of [2], Lemma 6.3, for all fc G Z and n > 1 

E [Q„ (Xk) \T<k-i] = P"Q„ (Xk^i) , (16) 
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where Qn are g-Hermite polynomials defined in |2], Subsection 6.1, with q as in 
(O- 116(1 and symmetry imply 

E [g„ (Xfe) \Xk-i] = p"g„ {Xk-i) , E [g„ (x^^i) \Xk] = p"gn (x^) , 

hence for n, m e N and fc e Z we have 

E [g„ (Xfc) g„ (Xk-i)] = p"E [g„ (Xfe) g,„ (Xfe)] = p"E [g„ (Xk-i) Qm (Xk-i)] , 
E [Qn [Xk-i) Qm (Xk)] - p"E [g„ (Xfe_i) g„. (Xfe_i)] = p"E [g„ (x,.) g,„ (x,.)] . 

Denoting x := E [g„ {X^) Qm {Xk)] ,y:=E [Qn (Xk-i) Q,n (-^fc-i)] one obtains 
p™a; = p"y and p"^y = p"x, hence (if n ^ m), x = y = and g„ are orthogonal 
with respect to C (Xk-i) and C (Xk) ■ By Lemma 6.1, [21 we deduce that there 
do not exist random fields with I? = and B < (equivalently q < —1) 
and (using also Proposition 8.1 from 0) that assertions 3. and 4. of Theorem^ 
are true (by Lemma 6.1, 0, in cases covered by assertions 3. and 4., measures 
that make Qn orthogonal are unique, so one-dimensional distributions of X are 
equal) . 

What is left is to exclude the case of (O, £> = and B > 2p^/ (l + p^)^ 
(equivalently q > 1). (This case was unresolved in j2j.) To obtain a contradic- 
tion, suppose that there exists X with this set of parameters and consider the 
conditional distribution C {Xi\Xo = y) . By j^l? Theorem 2, its monic orthog- 
onal polynomials are Al-Salam-Chihara polynomials (see 0] for more details) 
and satisfy the three term recurrence relation 

Pn+l (x) = {x - pyq"')pn (x) - (l - P^g""^) [n]gPn-l (x) , 

where [n]^ = l-|-q-|-...-|-g"~^. Since the distribution £ (Xi|Xo = y) is a positive 
measure, the coefficients at the third term in the above recurrence must be non- 
negative, thus (1 — p^g""-^) > for all n G N, so if (7 ^ p^^/™ for all m e N we 
obtain a contradiction. 

some m S N then conditional C{Xi\Xo = y) and two- 
dimensional C {Xq, Xi) distributions do exist. The question whether there exist 
relevant random fields remains open. □ 

Proof of Theorem |51 Fix A; G Z. Since by Levy's Downward Theorem 
sequence {E {Xk\Qn)}^°^^ converges almost surely and in Li, multiplying both 
sides of (|14ll by the indicator of the event {Xk-i ^ 0} and and letting 

n +00 we see that X„ for almost all u. Now define F„ := E {X'^^j,\T<k) ■ 
Then 



y„ = E(E {xl+k\r^n+k) |^< 



k 



1 2 2 1 - 

(E (Xj,^„_i|:r<fc) +E,{Xk+n+l\^<k)) - 9 /I , {Xk+n-lXk+n+l\J^<k) 



iTV " (i+p2) ) (^fc+n-ll-^<fc) + YTp^^ (^fe+n+ll-^<fe) 

p2 ^ p^ 1 

Y^Tj^^ {^k+n-l\^<k) + YTJ^^ {^k+n+l\^<k) = Y^-^Yn-l + -^-^—^¥^+1. 
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Therefore we have a recurrence with obvious initial conditions Yq = and 
Fi = E (^Xl^^\T<k) ■ Since its characteristic equation is 

-{1 + p2) x + p^ = 0, 

we have 

for some jF<fc-nieasurable random variables Ci and C2. Taking the initial con- 
ditions into account we obtain 

_ Xl-E{Xl^,\T<,) p^Xi-E{Xl^,\T<,)) 
^2 — ; 5 ' — 



so 



p2 ' 1 — p2 



_ v2 , Xj -E{Xl^j^\T<k) ^ 3„ , 

Yn- + 5 [P - Ij 



P 

From the uniform integrability assumption and the fact that Xn converges al- 
most surely to 0, 

xl^E{xi^,\:F<,) 

X, 0, 

thus E (-Y^.).]^ |^<fc) = P^X^,. Since it implies va,r {Xk+i\J-'<k) — 0, we have a 
contradiction, □ 

Proof of Theorem 121 By Theorem^ we have to examine three cases: 

1. (jH) holds with D = and C 7^ 0, 

2. B = D = 0,C = 1-2A=^0, 

3. A = 1/2, B = C = D = 0. 

In the first case B £ ^0, 2p^/ (l 4- p^)^ , what is equivalent to p^/ (l + p'^)^ < 

A < p^ / (1 + p'^) , so in this case Markov property was proved in Theorem 
2.3, P]. We shall present a different approach, based on (fT?)| . Of course, it 
suffices to prove that for ah fc e Z and B e B (R) , Pr{Xk+i e B\T<k) = 
Pr (Xfc+i e B\T=k) .FixkeZ,B eB (M) and define aj := EIb {Xk+i) Qj (Xk+i) , 
where polynomials Qj are g-Hermite polynomials with q defined by JSJ). M. Riesz 
proved that if a positive measure /i on K is determined by moments then C [x] 
is dense in L2 (p) (see 1 , Corollary 2.3.3). This implies 

00 
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Using one obtains that 



E 



j=0 



> 



> E 



E 



Is (-'^fc+i) - ^ ajQj (Xk+i) 



= E 



E (Is (Xfc+i) I J-<fe) - V a.fPQ, {Xk) 



Passing to the hmit as n - 



!■ oo and using (|17|l we obtain that E (Is (X^+i) |JF<a 
If ^ < +CX) then ^ oi^jP^^ log^ j < +00, hence 



Pr {Xk+i e B|^<fc) = E (Is (Xfe+i) |^<i 



i=o 



almost surely by the Rademacher-Menshov theorem. ThusPr(Xfc+i G B\!F<k) = 
Vv{Xk+i S B\J^=k) almost surely. 

Now consider A ^ 1/2, B — D^Q,C = 1 — 2 A. In this case all random 
variables are symmetric with values ±1, so this case is the same as D = 0, 
A = p^/ (l + p*) , and Markov property follows from Theorem 2.3, 

Now consider A = 1/2, B = C = D = 0. Then Xk = RYk, with R > 
and all random variables Yfe symmetric with values ±1. Since Pr (i? > 0) — 1 
and by 0, E{Xk\Xk-i) = RE{Yk\Xk-i) = pRYk^i, so E(rfc|rfc_i) = pYt-i, 
hence {Yk)^ is a Markov chain, again by Bryc's argument. Since R and are 
independent and (i?, Y) RY is one-to-one, X is a Markov chain. 

In the first two cases all finite-dimensional distributions are uniquely deter- 
mined by Theorem 2.3, Clearly, one cannot determine distributions of X 
when the third case holds. □ 
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